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Start with concept CI (210) 



Perform a search for relevant documents to CI (220) 



Analyze the relevant documents for CI, and determine "expansion 
concepts" El-l,El-2,El-3, etc... (230) 



Perform a search for the expansion concepts for CI - define the set SI as 
the union of all results found from 220 and 230 (240) 



For each document in SI assign a relevance score r with respect to the 
original concept CI (250) 



Repeat Steps 10-50, replacing CI with concept C2, and replacing set SI 
with set S2 (260) 



Find the intersection INT of the two sets SI and S2 (270) 



For each document d in the intersection INT compute: 

- Relevance: d_r = relevance(Sl)*relevance(S2) 

- Explanation of d is Expl(d) = the "concepts" that are contained in that 
document from the larger concept set CS. CS = {C1,C2,E1-1,E1- 
2,...El-n, E2-l,E2-2, ...,E2-n} (280) 



Determine relationship between CI and C2 based on relevance of 
documents (290) 
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perform off-line (training) 304 



perform relevance determination/ query expansion on-line 306 
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Submit initial user query to data source (310) 



Retrieve and score initial result set - assigning a relevance score 
to each document (320) 



Define the "positive set" to be those documents scoring over a 
specified relevance threshold (330) 



Build a "positive set histogram" from the positive set (340) 



Apply thresholding to remove features (350) 



For the remaining features, rank them by expected entropy loss 
(360) 



Choose the top ranked feature set as ranked in 360 (370) 



Choose the expanded feature set by applying "concept 
constraints" (380) 



Define the feedback-scoring-function (390) 



Submit an OR query of the expanded features found from 380 
(400) 



Score returned documents by function in 390 (410) 
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INPUT = 
QUERY + 



OPTION (STATE) 
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